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(54) CAMERA FOR DETECTING FACE AND ITS METHOD 

(57)Abstract: 

PROBLEM TO BE SOLVED: To detect more than one face 
in an image so as to improve the quality of a captured image 
by adding a value to image capturing processing. 
SOLUTION: A method for determining the presence of a 
face from image data is performed by comparing facial 
models for searching more than one face candidate regions 
with facial probabilities to previously screen the image data 
with a first algorithm, and by performing operation on the 
face candidate region with a second algorithm by pattern 
matching so as to check each face candidate region and to 
confirm the presence of a face in the region. As for 
detection level, a combination of the first and second 
algorithm has a higher performance than the individual 
algorithm. A digital camera includes a memory for storing an 
algorithm and an electronic processing unit for processing 
image data with algorithm so as to determine the presence 
of more than one face in the scene. The facial data is used 
for controlling exposure parameter of image capturing or for 
producing processed image data that associates color 
balance to the presence of faces. Alternatively, it can be stored on a storage medium together with 
the image data. 
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2H^«t'7PL<ie*8S^Tv^) . mmmttzm- 

86) . 

[0030] %3<n>mi3m±. mzwi&nmftzmw 

hi.oWM.-ti> (XT--/X187) . mtf. fflco*^ 
y)<r>Mtf1) XyT/*—*f-*1,z£-?XW*)nhi\X^hZ. 
fc£ijcf*§-& (XT77188) . TU7M 34(i 

mmZizMLXW&t&ioWtfeZtii, (Xr-yXl 8 

9) . &4<7)®sh^m±. mnm-b$:*¥%mzfflim 
(XT77190) , m&&M<7>*¥%m±.i l z$>z 

£?Xh&M& (Xf77192) . fVA7W3 4 
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mtLXm&Ml&tl&lMPXriU and ScanlonO# 

« 

[003 13 [gi^lBta^-K] 03^$ii§J:at; 
tia^T771 5 07^1 80**-!?-*. £>*VO*ix 

sg^-e^ r . 04 i;*?ft5»ft<?)Af 7 7*20 

0^M2 4 0J4. I3KS?)(l5^f7710 0Ml 
40fc|3|— Tb&fi:)b. KKUffttL&t*. 5g£. 04 

immx-btiummmmx'^ ysmmtm 

3 4±.X%.$>il& V^B«*^-if fcfc oTiH 

LTf5tff£*x3£>. lvffuo*§3-fc, fti&Bt&^-KO 

[0032] immxi-'oyxi Affie>m , m&im 

« % is- y&tt-tz S o X fS$t W&SAft Zfm-f h i~ \Z 

wacii *t#u7>e.ji. jwb6**nae. -^sat. xn 

fyfXr-yftcoZtlX'kmtlzJLjL&fiK Ztl$>(r>3 

xtvw^uxa <cba) tmm-t&zktfftiitix^ 
msa, 3nzmi>mm%i'->%mi^*xmmL£o 

[0 0 3 3] Mi&<ntt7-'^>z-&^ is-ypcvtm. 
crMmz^XnM^fr<vmMb*ftb<nm*t&}*i:n& 
&Z%mz?Jtt&Ztiz£-?Xl;*)&<'fThii&. is— 
y^fotfjELKmkZtihijK SRcofea^&O^T^ 

X<Dmfrt>1xhT^<r>Wg.\iXttAz x ->xm%& to 
co. Afflmn&MWiELKmZiZtiXiW^klz-o 

^xi&tfflzwmTS>&. mtc&tMmfAW.zz.&m 
cry&mozmiii. mmizttmztiwmtio h . k 
iz, ®mzi>. Ecofecoa^co#ant&ixE(7)fecos± 



[0034] >+cO^«?)^S&t^fiat-3V%T<7)»l 

m*. 2^<r>m%&-Hmz*.~>ximztitzti=7-rt i 7 
fltfir, r-< it*>iymz.T-yT&mm*imx'$>tiii . n 

SES*i3 4. iiiii. ±S=3:»^f*: (A) &tf?Ta*« 
&v:M>:*r&&. l Ott, ^ 

xr;^'JXA88^fflffi5tfflIEXf->y7°2 6 OlCfcV^ 

rfflffl-rs. 5eKi*jewt=a, cpu3oj±. t^m^fx 

V vc ft >*5 yX7^rf "J 5rS^ff trr ■& fcJfc 
IC, itilfa4 9^J:oT^.§tL2.-ai^7W-A4 9a 

[0035] [*BiM*aa?/»iE ] i £ fc#JSk LTtt 
»A*tfe*L4ftafc:««3*l.**BWWF»5. 432. 
8 6 3^l,Zffl^tl&TJ]s3V X&<7)£ oKftB&liiT 
;Wrf'JXA8 0{i. *BffliEXx-yX2 7 OfciS^TS 

@<?)#ttti^^. gStS^ttir/P^'JXAtcioT. 
SS3 4±t'jia : S:aS^liSL3Sa^>f ^7i- 

4 iff /Ml* JVhtlK. a«Xt*Wf«Rft#VV\-f 

[0036] [ 1*1* V-^ ft»t ] £9M»#f£Mfc± 

±T«ii: trails £ fc^T'# s . a(ciaTi«w-« 
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mztt Lxtnzmmxy- 77280 t:±5 v vt £ 

fficofo £ Iz ± o T ffiigS ili, jE t V ^ # <9i£«?£fl"$- . 
[00 3 7] [H^MltN -MMtimtii^tLht. 

f-?^-X7 2icfete$ftT^s*2#f^8H d f>5 

J±immZ1xoh. 1±, 0!li.Jfts3&7>-A- 

T)Vzt >J XMz J; TSfcfcS ft£#fflAtf>!&8'Jfif*B»;i. 
BMfc x : J?>vmms.3 2Xliy -f 2 5 

igsns. m»i. m®*c7>A<v&mt:%miz&Mmz 
?*jumrt&teMz&mzti.o&, mco^sm&mm 
m-nAVtximgizZ'ixmfezti&A'mnm* 

s. mmm^mmmrju^v xmz-o^x . ^k^ot 
<rtmnmBamaifii>&. mz.tf. visionics*!^ 

TFace-Itj vX^Ati, mSMT^V XM.bLX<T> 

mmiz&Lx^&. 

[0 0 38] [SEUtJT^rfUXA] -f -f V9A>tl*9 

^xmm-i,mmtarjv^u xm.h. m*wmt>tifcm 
at: (ap*»i»HT) x\ *o#®g*/^»^is* 

<0«iaj$^ov vr;-HH:*i.>ttt6*#3 fc«f =5: ^>=5r v 
%izJ:-?xmi2ti&ZbiiT/U3V X 2»<r>9i.mz1$ L 

xmnmmmm^&b-rh i>vx*> s . 

[0039] *WWrcii. «^^§ixT«ffl$n^ 
i t tcfc ^tti^WcWLTJira^TVi^ U xa j: 

it&&m-rhzbzmm-t&. mi<7)m&*^u-?. 

&]frX?y-:xg|IT£>£. m2<7)^aj^^P-^. HP*> 

J: ->Xftmttl1t>tlhm£Ziifi:^?- V* *t+V 7T 
/Hf'JXAT'ifc*. ayiK-^ybwta-j-c^/W 

[0040] [n hW] Wu?M±, T-f^'^ 



fcowcSfeStLfc (ZZlzmmb LTffi*A 
ft&il&Wu, H. , Chen.Q., and Yachida. M. , "Face De 
tection from Color I sages Using a Fuzzy Pattern Ma 
tching Method", IEEE Trans. Pattern Analysis and M 
achine Intelligence, 21 (6). 557-563. 1999#B8) . 

TfnyxMrn^zmmx-fo*) . 7o/7^tua 

?%w->i2m*'<i'-?x*>&. 

n-s+iiiaii:. *?\z*)&Bi.vBmzm^x^zi5ts 
^w^&(Si^b®.bti&mmm& (fi<o±*^w*^ 
jio) sr^-rss^ai-t. jjma&mmzm^Ktzib. 
umimft-r &mmi±GWfc%m®&x-$&itztih z 
btf&webz. 

[0041] a>X-*.y\-mt. ^my^-XbWM 

7!-XJ^. ?i7x-Xil, Jill&tPfeScOfeft 

frt>tc&. im7*-xx'iz. ma. mm^mz. xt 
—iumf&.me>±xcv&MX'7g&-£ti& . 3 

* Mzmwwfa zbmmztixi^zb t mz&%. lx 
us. z<r>fam±. ^mzmmnfoziz-o^x-®. 
ffi^ifco&mzm® (**7te±Tizimm2ti%^fi: 

#>m£L<l±3®) m?fr&ZblzJ:~iXmibt>ti&. 

mt7*-xx'i±. Tfc^vx^iimzti&^&M 

[0042] ( 1 ) BHW^<7)Il^V-yX$rlt*-r 

[0043]f-f ^*?/l'®ffi*^#HS£flOU> r **tf) 
feoEir^lil^-X^kib^L, HS**A^«oIllX«i 

b m tffiMfc-fc >Wz X oTJR^ as . 

[oo44] ( 2 ) imMx^is-fz-frLxmrnzm 

[0045] j|W«^7 e /W4, ^11^75^ >X¥% 

mfrt>mmzti2>. zti^^fMi. mmmfrm<?>x 

-X<r>>b*\M<n*<7)^m&JEmt%1xtzAffi<r>ffl,z 
[0046] ( 3 ) a^ffrtT-Vt-Srffll ^T7r y-«? 

mizmfo-tZtziblz. ^rn-kxiih^m^^iz 



1 
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imthZ t tz&-3< . y r V-iffiM . UuWJtMiz 

[0047] jar, mmttTMz^xmmuz®. 

Xl±toi<H-<r)lMZ&m-fZ> - 1 -oX fifth Z\ttm 
MZti&'<$X'$>&. 

[0048] [jgtt^T-'/p] mmm^Mi, mm) 
mm$mx'$>&. ^mm^-x^mm^i^^ 

cr>^)Vft^£*) (ZZX'te. m=12X'$> t ). n=l 

o) N &*M±m^x-x^h&&Mm%m&iz'o\,^ 

X. (m^fMz^Xte) mz&iX&tbhixh^iV 
<rm&. Xl± (^ErfVWcoivcti) ^tcioTA 

/Kt«o-b/K~*f lx ^mmzMmwf i>ti o & . nwm 

^fr-tMzttmLoi. tf/Hi. 2-?cD@2r«i(i« 

ey^nmm^xmmztiz. ^mmzimitzii*: 

BflU2« »:^Ji)l«^t/^ffl^#»T--b^>-h^ 

tf-x\,z^\,\x<nW^T>v<rm*^-tWrch&. 
Mi. ^smi-^^u-u^un^ttrnz^^- 

[0049] i^mRx/wmmzsmi zem&x-n. 
^mmmft^K<D^M/^mcr>^iz^x<7)mmfi^i 
tmttzttfBWctoh. sma. jus-skin. 

hair. fe£colorfc L£i:#. P (skin I color) Rt/P 
(hair | color) OJ^CO^t— 7)V*W$ft t 
X'hh. Wui'rW^:^T'»iFarnsworthc7)*D«;Wec%— =5:6 

^«H«fcK8!W-*fc«>»ca* L^Wfeifci: UT ( L, 
s. t) fe^HJfci&BU ^T, (L, s. t)S3fe 
£?«g^W&tmffl£^U fiU L = c (R + G 
+ B) ; s = a (R-b) ; t=b (R-2G+B) ; 

a. b, ciise*:R, g, &\mntt®Lis->m\&z 
itm-tmmmxhh. zem&mi* m&*zyx>v 

fcZmtt^*Ti®ti&2g%X'hhz\ t ftWRZtitz. 
3m£X0)'f-**)l>tf&m2tLh1)K 

J±*X'>V 5 ±yxi"r*M*mfr-&frZ titz-7 o 5 i-y 
[0 0 5 0] MwfeOi&frffi£*#>6*:tf>. 18 0 OH 



^xmfezn&ty-j^yxxxs&^&vBmk „ 2 

fiat^ffl^T'fcs. AWM&miz^itfflKm*: 
T^zm^x. 7 : —?'<—xt\*<7)±xcDmi / z'3\,^xm<7) 
mmmztiz. /ry-^yxRx/^^comm^t 

ti&fcjrF*)^ h 'J -/ ?*trJI. 
[00 5 1] 
[»11 



71 7T 
1 

"71 
1 



(2 



,*7? 1/3 



7T U 



*«wc (l, s, t) m&m^$m2ti, >^ 

(L, s, t) £fS<£ofe<^fl]£4-;L£. 

bXr-^AJi:. **0*&&£:2&7i;i7)s, tt^b/ 
fcfft&SftS. dcoiaic. JDL&tf%S<0 

m^xznwmizm Ltmua^^fa^H 

z\<rm%cv&$k. m&AJBtXfS&b. 09 
ASt^9 B {ZTF^ixh J: 3 ^fiatX^58*^JKcO 2 o 

n^mB*5l*St/^B3g5I^O^^ O 2 o<0BISr* 

[0052] [ msmRtf^mmzimz tt^mmm 

ffimzttwzm-t&mmz&X; -it. imcoRmza 
v ^Ttrsc$ KKmmtmmmmw^n^n&tzmpt 

i*i^<l*Sr*fc*. 2oofflf8^x^*'JS:It^ifc 
LTB«i^4»^S|*il*«^$n^Jlllrfi^J-&SV^ 

[0053] 
[i&2] 
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S(x) 



0 



(a+b) 



x ^ a 



{b-af 
1 



2 

<x<,b 



b<x 



lz£-?x*j-z.e>ti&. 

[oo54] w\-<vjm&. mw<7)%mimm± ts 

=ffV<Ti^ left L T ^ *9 * - * a &t>' b S-S'J^ fcWf 

mznm-thwz&^mx-hzzttfft-h^fz. z<r> 

y^-*y r-w* iis#< nm>m&£mi-t&fz*btz 

[0055] imsm.^iv^m^xyr'j-^-y 
~?»/+y7zmx7-r&i &^Mz^x<mmmn& 

mth m®mm<nm tmosjea t x. hnx v > s t 

[00 56] 
[§S3] 

similaHty(l ty l h ,M s ,M h ) = e -*<(U.^A)» 



dist(l t ,l h ,M„M„) = yl{l,-M,Y+(T k -Mj 
P (face I image) 

izttLxzzti&zzizimzti&mmm. 
®<vftmimizmmm%t>c7y\&it2it&. sm±. 

fSMMfcSftJt^HljP (face | distilled-image-featur 
e) fc»T, **lfcJ:»)«lffiStlfcWfl»l« (distilled 
-image-feature) #ftlfc£*U ¥^WZMU£ 1 0 07T 
b i nA»4fc«>4.<l&;fcT»*. ^B^SH^l"-* 
c^MW^^TSJi. b i n J: 0 i> 2m*—yritt±% 
^mtf<mtZtl&Zb£*-t. fe^X, 1 OScOb i 

^3 %<?>®r?fr*mwtMzft*£-z*t& z kw*imx'b& 



h. *50fcWTtt, JftfeftxagBRft, Ia = 2St/b = 
LXWthtLZ. ziytf-^y^Wlzli^XtfiliiZtL&m 

[0057] [3 ytf—^-y V S ] SchneidermanTA'3* 
UXA (KIT, fcftrfS) fcOWtcO 

Piffl^lftBHJis Cl^C#^i:Lr«^Ait^ixSSchnei 
derman, H. and Kanade. ."Probabilistic Modeling of 
Local Appearance and Spatial Relationships for Obj 
ect Recognition", Proc. CVPR 1998, 45-51fclB«$it 

zttRit^xm^tt-rhmmmmmmz^xm 
m-t&titbiz. zzx-mm-tz. ay#~-*yhs\i. 

faceted imageiiB*-C*&hi-&i:, *frf*£58* 
ftlfjP (face | image) *mfr&mmZtlfi:WWMi 

zm^xm±<»mm%:ttm*fit(: x*ww-^u 

^fc*l|irfc:fflj£S*lJfc¥S$MnP (image I face) 

nwmt. mmmtfm&X'b^xhx^k^owmiz 

X (flRJf^ny^xhTliffl) iz^M^BX/i^ 
-yii, (=ffl) o*MPSt^ai.^>ixa&H«^N- 
?-ySr£t£-£3&. "^XOHSfi. r T7-^Hj 

-^<. SiJi (^=5r<tt'7-/PKtit«$7XS^i) 

mz^xmrnizmw-rz. 

[0058] aTOOrtfi. 

(1) 

co-c*&«^4. %<<Dm*mirhzk&«sifcX'h 
[0059] isi^wi, iikT^mx-mm^it. wto 

-fe ^ ^ a y ^t>^-ci»Hj§ix^ . 
[0060] (l)ffl«m«£lI2{Mbt-&. 
[006 1 ] ( 2 ) fB^SrMUmijSMWS-?- S . 
[0062] ( 3 ) SJ«&FS<9tfc#tt£&§8H-.g> . 
[0063] (4) PCASrffl^TgfllS^iOffiV^ 

[0064] ( 5 ) »fl»fcfflV»-C«»*«F^tr & . 
[0065] (6) tt^lS^i^lrrS. 
[006 6] (7) ft®8.VikW*ftM-t&. 
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[0067] ( 8 ) imw*?->^^x<r>im.*m 
[0068] ( 9 ) fta<?)^^->'icou-rfi[a«c#'ft 
[0 0 6 9] (io) mimffi<?>m&zm&Lx 

P (face I region) 
fcSSfcU ffiU Sliface, fii(£Jiregioni:-f S i: . « 
t$i*> j: -3 fc\ 5 6x5 6cofflS<oHtfc*ga»S>t7)H3fco 

[ o o 7 2 ] 2 . mm&wffi&^ftM-th . 

[0073] &W*Mi. ZfSWWZ'Oito 16X16 

mm*PG.\mfflmte^x<D 1 9 em^m^m^im 

ot. j* (2) ofefflKfcwc. r««j « r <$Kg 

wmmn^mi, mmzmw.$tifc®&u. ®«comm 
m^wm (mum. x«±n> z&tsni^+Mz 

Yl P{face | subregion. ) 

[ 0 0 7 7 ] 4 . ±WmftMVi ( PC A ) £fflVvC9fig 
[0078] IiJffl*SJ±. (=*f L/C 2 5 6 OjTV-P 

mmn&&\ aw>«JM:ii, ®m®<KX7t<&$2 5 
«iffi«T** . m<m<?>mm®cr>ft%i<7) 9 0 %uLtii 1 

2OToa^7t$-fflV 1 .-C»^b$fia-l.. ) PCA£Hfi= 

[proj] =A T [subregion] 
lZ£~?Xm?fZtl. projti£f^ subregiontiM 

«WL A(i^^91^^@W^^ WW (±gJfcft) 

izttLxcox.ftm-r&zttz®m2ti.tz\ / \ tamtLx 

/=1 

[0081] 5. ®m&m^xw&*$&ifcth . 
[0082] §mmmt. 1 2m±x<ry®%mL*& 



[007 0] 1. BSttTO&iMIMt:-*-*. 
[007 1] «Sga«HCjBHt$*».fcWi, 5 6 x 5 6B 
**>«W>itnc*bS*iS. iWWJU-fbtcJ: 9 . * ( 1 > 

(1. 

(2) 

[ 0 0 7 4 ] 3 . M®im<omfmmm-& . 

[0075] M«motiH^«H%a%?/MttifT 

— onEzmm-zMz+ttcowmz-kx-? h^znv 
x . wren mm%&®mt$azb*), 2ooit:ov^ 
<mw&i&m&mz^xittmztL%\\ 

a^<ik«SUJ*S:^. £WfS#-fc£fflvvt, sft (2) 

[0076] 
[»4] 



(3) 

m%zm»miz&^x*'Rm:mmjmt^--7ti:&a 
w-y*±t. mux\ m^zgtehmnx-xizx 
->x&ri ^mmwco®^frco±m*^ttimx'\ih 

[0079] subsbicj: o > zmmffltatumm 

Wfci&-»fel2»©«iMIWtJ:-5T«*>S*i.4. £<0 
#SKS«£ 1 2ffl<0±g#^«*)«JB&Z)»£ 

ants 

(4) 

wtmmztuttw zafflsotam. * < 3 ) t±> 

[0080] 
[»5] 

(5) 
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kizx^xmizmmizztiz. znmzLx. 12m 
<mmm< w&ntzmz e *i4 . 

[oo83] 6. ffimzm^tth. 

[oo84] mmmm<?)Wiz>Em&. 04 h • v-y 

O^^TT¥^¥;fr»Tftl^£*bMfc3-4. 
*^kffl^V^60*iltttC-3V^T{i. b i n(fib£& 

/WL£;fU .Ifc.t4Liii. J., Two-Dimensional Signal an 
d Image Processing . Prentice-Hall : New Jersey, 1990 

[0085] &&zixm&&<r>miv&&mzm o m 
itth^m%ttim<nfk*m?*h . &&jt*,znL,x 

8o. 4iXli2-ocO&^t]/«Jl'*mifiLX „ 6o<0 
^t^#7c5:SlfR-r4<r£:fc:J:'K 7VP=f l>X-M±Hj&£ 
$Jx4fcifti, ooo, oo ocoilco^coiofcj;-? 
T4H«««*»b Ld4„ £*t^*T*t$;rut&t4. 

l\P{face\q\ l ) 

^fS#-fbS*L4. 

[0088] 7 . *rii£.tf&a£#»-r 4 . 

[0089] «l*^c7)|S#^<0Mit<0C:^tC*JV^ 
T. (6) «4fflfa«OB*^-VfcSifg$l%W> 

XlP{face\q\,po Si ) 

(pos) £4oT**>£;ri.4. 5$ (7) 
<7>#£8?«4. SBWKJ-XRD#*.5-£t$-y:4. H0*>. S 

*±ir4{4rc'£>4. 

[0091] 8 . *3MT'&(. v/^-j/fc-^wc 

[0 0 9 2] ^afffiWtd^LTl. 0 0 0, 000«) 

i^Ffb^^/usv 1 9 6 mnimtmnx'hh t # . ^ 

(7) izm-ZWK&fS&ittfKZttlttilXKt** 

w z<o^zmi.x 2mm%&®mktf&ztiz> . m 

i=i npos 



Schneidermani'rfD&iRlw^vOK £> avfirfllf C r q 
1 J €fc&$*t4*>tf)T;*>4. "Tflg&q lfficOgtJi. * 

co^iRtcij^r r nflJ fc^fisr/p^ux^^x 

[0086] Z<0mTitX*-£,C0Effi<r)tQ&i3.. 2 5 

ASrfflm^ftOJ^Kt LT#*.4<I fc**W?fc4. 
MSt£ **>8*H13Bj*> Wflbfrr 4 £ t <is T^BftO 
$>Satf0ifi{KS-^-iS. HlOli, T^W&fc. PCA 

mx$>&. Igfclf^W^i, HI OAfiTOWmS-* 
U 12 1 0 B{4 1 2<0$tt<7)3Lm&#2B^<7)Wmm<r) 
tmfrt>(DimfttZKL. 01 0CJ4H1 0 B«0i^«F^ 

BRtsmi oc<7)mm&£x<Qft^tztifctimz^i- 

tiWCI*5rv^fct=«BS*ifcti. £*,4>J4tfL<!>, gij 
g?i£#5 6X5 6«0ffi^c0ffl#ft&^i:^lJS^??^ 

4. ) i^fcSWKH** OTOA ( 5 ) 14. 
[0087 ] 
[86] 



(6) 

[0090] 
[»7] 

(7) 

Tlcy-bS^4^TWq U^-y^fliWitjcfflt 
->(?>mZ. Schneldenan«tiURifi r nest j tfcZtl 

hT)V3VXj**r4x$em.n*7*-9X'hh. ftii-csr 

W**-yfcOVvtfcfc, * (7) 14, 
[0093] 
[»8] 



(8) 



t * o , 3W». npos-i96 14 ^mtemmnfts. 



c^RT*4. 



I 
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[0094] 9. &m>*?-yiz~o^x<7mmtfi&i : fr®. 

[ 0 0 9 5 ] ( 7 ) K*|~$-&g§-OjSiMb{±, ^W* 
[ 0 0 9 6 ] WHrHt^WT/l-rf UXAIi, «S£ 

h^z— mas c: t tcj; oTH^sas r «v ? 

[0 0 97] #^ WWxtCOWt, Stifi^ttW? 
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